This Page is Inserted by IFW Indexing Scaling 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 



Defective images Within this document are 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE COT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 
Q SKIWED^LATO'ED IMAGES'- r 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL BOCUMWT 

□ REFEMENCE(S) OR EXHMT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: ,, ■ — " — ~~~"™~ 

IMAGES ARE BEST AVAILABLE COPY. . 

As rescuing these document will not correct tke image 

problems checked, please do not report *«t problems to 

the IFW Image Problem Mailbox 



(19) 



J 



(12) 



(88) Date of publication A3: 

18.08.1999 Bulletin 1999/33 

(43) Date of publication A2: 

27.05.1998 Bulletin 1998/22 

(21) Application number: 97120491.2 

(22) Date of filing: 21.11.1997 



Europdisches Patentamt 
European Patent Office 
Off ice europeen des brevets (11) EP 0 844 571 A3 

EUROPEAN PATENT APPLICATION 

(51) int. CL 6 : G06F 17/28 



(84) Designated Contracting States: 


(72) Inventor: 


AT BE CH DE DK ES Fl FRGB GR IE IT LI LU MC 


Masui, Toshiyuki, 


NL PT SE 


c/o Sony Comp. Science Lab. Inc. 


Designated Extension States: 


Shinagawa-ku, Tokyo, 141 (JP) 


ALLTLVMKROSI 






(74) Representative: 


(30) Priority: 25.1 1 .1 996 JP 31401 096 


Melzer, Wolfgang, Dipl.-lng. et al 




PatentanwSlte 


(71) Applicant: SONY CORPORATION 


Mitscherlich & Partner, 


Tokyo (JP) 


Sonnenstrassa 33 




80331 Munchen (DE) 



CO 

< 

T— 

in 

oo 
o 

CL 
LU 



(54) Text input device and method 

(57) A text input device (30) and method is dis- 
closed which enables efficient and high-speed input of 
texts in a pen-input computer. A pen-input computer has 
a liquid crystal display panel (8), a ROM (2) storing plu- 
ral words and plural exemplary phrases, a pressure- 
sensitive tablet (9) and an input pen (25) for performing 
input to a soft keyboard displayed on the liquid crystal 
display panel (8) and selection of candidate words dis- 
played as a pull-down menu or pop-up menu, and a 



CPU (1) for retrieving a candidate word displayed on the 
liquid crystal display panel (8) on the basis of the input 
from the pressure-sensitive tablet (9) and the input pen 
(25) and/or a determined character array, so that text 
input is performed by selecting a desired word by the 
pressure-sensitive tablet (9) and the input pen (25) from 
the candidate words displayed on the liquid crystal dis- 
play panel (8). 
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Description 

BACKGROUND OF THE INVENTION 

^^ield of the Invention 

This invention relates to a computer capable of at 
least inputting texts, that is, a text input device, and a 
text input method suitable for efficiently inputting texts in 
the computer. 

Description of the Related Art 

Recently, improvement in computer performance 
and miniaturization techniques have allowed various 
portable computers to be used broadly. Particularly, a 
so-called pen-input computer without having a hard- 
ware keyboard is convenient for portable use and is uti- 
lized as a general-purpose computer for an increasing 
number of occasions. 

Most of the currently commercialized pen-input 
computers employ a handwritten character recognition 
system or a character input system using a so-called 
soft keyboard on the screen, as the system for perform- 
ing text input. The soft keyboard realizes substantially 
the same function as the hardware keyboard by display- 
ing a keyboard image on the screen in which key 
images corresponding to "hiragana" or "katakana" char- 
acters (both are Japanese characters) and alphabetic 
characters are arrayed in a predetermined order, and 
then pointing a key on the displayed keyboard image 
using a pointing device, for example. With respect to the 
keyboard image, in the case of hiragana characters, the 
keys are arrayed in the order of the Japanese syllabary, 
and in the case of alphabetic characters, the keys are 
arrayed in the alphabetical order. 

However, in the case of the handwritten character 
recognition, since the character input speed of hand- 
writing is limited and correction of false recognition of a 
handwritten character by the computer is troublesome, 
it is essentially difficult to improve the input speed signif- 
icantly. It is considered that the character input speed of 
the current pen-input computer capable of handwritten 
character recognition is approximately 30 characters 
per minute at most. In addition, in the case of the hand- 
written character input, the user's hand will be fatigued 
with input of a large volume of text. 

Also, in the character input system using the soft 
keyboard, "kana-kanji" (Japanese character to Chinese 
character) conversion is performed with respect to a 
character inputted by using the soft keyboard. In this 
system, since characters on the small keyboard (soft 
keyboard) displayed on the screen must be continu- 
ously picked up accurately, the user's eyes and nerves 

•may be fatigued, and the input and conversion are time- 
consuming. 

Thus, in view of the foregoing status of the art, it is 
an object of the present invention to provide a text input 



device and method which enable efficient and high- 
speed input of texts. 

SUMMARY OF THE INVENTION 

5 

According to the present invention, there is pro- 
vided a text input device including: display means capa- 
ble of displaying a virtual keyboard having at least a 
plurality of keys for character input; input means for 

10 pointing at least each key on the virtual keyboard to per- 
form key input; dictionary storage means storing a plu- 
rality of candidate words and a plurality of exemplary 
phrases; and retrieval means for retrieving a plurality of 
candidate words from the dictionary storage means, 

is using the key input from the virtual keyboard as a 
retrieval condition; the retrieval condition and the candi- 
date words being dynamically changed in accordance 
with a change in a key input operation state of the virtual 
keyboard. 

20 According to the present invention, there is also 
provided a text input method including; a display step of 
displaying a virtual keyboard having at least a plurality 
of keys for character input; an input step of pointing at 
least each key on the virtual keyboard to perform key 

25 input; and a retrieval step of retrieving a plurality of can- 
didate words from a dictionary storing a plurality of can- 
didate words and a plurality of exemplary phrases, 
using the key input from the virtual keyboard as a 
retrieval condition; the retrieval condition and the candi- 

30 date words being dynamically changed in accordance 
with a change in a key input operation state of the virtual 
keyboard. 

That is, the present invention provides the text input 
device and method suitable for a pen-input computer 

35 based on retrieval and prediction of characters, words, 
and sentences, etc. Thus, the present invention enables 
efficient and high-speed input of texts by repeating the 
operation of selecting a word from a set of candidate 
words which are selectively collected by partial designa- 

40 tion of reading and prediction from a character array 
immediately before the input position. 

BRIEF DESCRIPTION OF THE DRAWINGS 

45 Fig.1 is a block circuit diagram showing a schematic 
circuit structure of a pen-input computer of an embodi- 
ment of the present invention. 

Fig.2 is a perspective view showing the pen-input 
computer of the embodiment of the present invention, 

so obliquely viewed from above. 

Fig.3 illustrates an example of an initial display 
screen of a liquid crystal display panel at the time of 
Japanese input in the embodiment of the present inven- 
tion. 

55 Fig.4 illustrates an example of the display screen 
(pulldown menu) in the case where a retrieval condition 
(reading) of V is designated. 

Fig.5 illustrates an example of the display screen 
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(pop-up menu) in the case where the retrieval condition 
(reading) of Y is designated. 

Fig.6 illustrates an example of the display screen 
(pull-down menu) in the case where a retrieval condition 
(reading) of "ika" is designated. 5 

Fig.7 illustrates selection of a candidate word 
"ikani" from candidate words of the pull-down menu in 
the case where the retrieval condition (reading) of "ika" 
is designated. 

Fig.8 illustrates an example of the display screen 10 
(pull-down menu) in the case where a retrieval condition 
(reading) of "hon" is designated. 

Fig.9 illustrates selection of a candidate word "wo" 
from candidate words of a pop-up menu displayed in the 
case where a character array of "ikani honshuhou"is is 
determined. 

Fig. 10 illustrates selection of a candidate word 
"mochiita" from candidate words of a pop-up menu dis- 
played in the case where a character array of "ikani hon- 
shuhou wo" is determined. 20 

Fig. 11 illustrates an example of an initial display 
screen of the liquid crystal display panel in English input 
in the embodiment of the present invention. 

Fig. 12 illustrates an example of the display screen 
(pull-down menu) in the case where a retrieval condition 25 
(reading ) of "F" is designated. 

Fig. 13 illustrates selection of a candidate word 
"first" from candidate words of the pull-down menu in 
the case where the retrieval condition (reading) of "F" is 
designated. 30 

Fig. 14 illustrates selection of a candidate word 
"first" from candidate words of a pop-up menu in the 
case where the retrieval condition (reading) of "F" is 
designated. 

Fig. 15 illustrates a format of word dictionary used in 35 
the pen-input computer of the embodiment of the 
present invention. 

Fig. 16 illustrates a format of exemplary phase dic- 
tionary used in the pen-input computer of the embodi- 
ment of the present invention. 40 

Fig. 17 illustrates a basic structure of a state transi- 
tion machine used for explaining fuzzy retrieval. 

Fig. 18 illustrates an extended structure of the state 
transition machine used for explaining fuzzy retrieval. 

Fig. 19 is a flowchart showing the former half of 45 
character input processing in the pen-input computer of 
the embodiment of the present invention. 

Fig. 20 is a flowchart showing the latter half of the 
character input processing in the pen-input computer of 
the embodiment of the present invention. 50 

Fig. 21 is a flowchart showing the former half of drag 
processing. 

Fig. 22 is a flowchart showing the latter half of the 
drag processing. 

Fig. 23 is a flowchart of predicted candidate retrieval 55 
processing. 

Fig.24 illustrates measurement results of input time 
in the case where an exemplary sentence of 128 char- 



acters is inputted using the pen-input computer of the 
embodiment of the present invention and an existing 
pen-input computer. 

Fig.25 illustrates the relation between the number 
of pen operating times, the number of candidates dis- 
played in the menu, and the probability that a desired 
word will exist in the menu, in the case where English 
input is performed. 

Fig.26 illustrates the relation between the number 
of pen operating times, the number of candidates dis- 
played in the menu, and the probability that a desired 
word will exist in the menu, in the case where Japanese 
input is performed. 

Fig.27 illustrates the relation between the number 
of pen operating times, the number of candidates dis- 
played in the menu, and the probability that a desired 
word will exist in the menu, in the case where English 
input is performed while predicted candidate retrieval is 
not performed. 

Fig.28 illustrates the relation between the number 
of pen operating times, the number of candidates dis- 
played in the menu, and the probability that a desired 
word will exist in the menu, in the case where English 
input is performed while predicted candidate retrieval is 
performed. 

Fig.29 illustrates the relation between the number 
of pen operating times, the number of candidates dis- 
played in the menu, and the probability that a desired 
word will exist in the menu, in the case where English 
input is performed while predicted candidate retrieval 
and adaptive retrieval using the dictionary are per- 
formed, 

Fig.30 illustrates the relation between the number 
of pen operating times, the number of candidates dis- 
played in the menu, and the time until a desired candi- 
date word is selected from the menu display and 
determined, in the case where text input is performed 
without performing predicted candidate retrieval. 

Fig.31 illustrates the relation between the number 
of pen operating times, the number of candidates dis- 
played in the menu, and the time until a desired candi- 
date word is selected from the menu display and 
determined, in the case where text input is performed 
while predicted candidate retrieval is performed. 

Fig.32 is a block circuit diagram showing a sche- 
matic circuit structure of another embodiment of the 
present invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Preferred embodiments of the present invention will 
now be described with reference to the drawings. 

As an embodiment of the text input device and 
method according to the present invention, the structure 
of a pen-input computer is shown in Fig.1 . 

A pen-input computer 30 of this embodiment shown 
in Fig.1 is a portable pen-input computer which includes 
a small-sized portable casing with a relatively large iiq- 
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uid crystal display panel provided therein, and is thus 
capable of displaying characters and figures based on 
data inputted thereto, on the liquid crystal display panel. 

• The pen-input computer 30 shown in Ftg.1 has a 
entral processing unit (CPU) 1 for controlling the entire 
constituent elements therein. The CPU 1 is connected 
with a read-only memory (ROM) 2 storing therein a 
basic program referred to as a so-called operating sys- 
tem (OS), a text input program for realizing pen input, as 
later described, a word dictionary and an exemplary 
phase dictionary. The CPU 1 is also connected with a 
RAM 3 adapted for temporarily storing input data and 
provided as various buffer memories as later described 
The CPU 1 is also connected with a card slot 4 to which 
a memory card 5 as external storage means may be 
connected The CPU 1 performs processing of data 
stored in the RAM 3 in accordance with the basic pro- 
gram stored in the ROM 2. In addition, the CPU 1 reads 
and transfers data from the memory card 5 connected 
to the card slot 4 to the RAM 3, or transfers the data 
stored in the RAM 3 to the memory card 5, in accord- 
ance with the basic program. Thus, the storage area of 
the RAM 3 is also used as a work area for the data to be 
processed in accordance with the basic program. In 
order to enable version up in the pen-input computer 30, 
it is desired that the ROM 2 is a static rewritable mem- 
ory, such as, a flash memory. 

The CPU 1 is also connected with a liquid crystal 
drive circuit 7 via a so-called application specific inte- 
grated circuit (ASIC) 6 as an interface. The CPU 1 per- 
forms display control of a liquid crystal display panel 8 
connected to the liquid crystal drive circuit 7. 

On the surface of the liquid crystal display pane! 8, 
a pressure-sensitive tablet 9 is provided. When the sur- 
face of the pressure-sensitive tablet 9 is touched by an 
input pen 25 or the like, the pressure-sensitive tablet 9 
generates a coordinate position signal indicating the 
coordinate of a position touched by the input pen 25. 
The coordinate position signal generated by the pres- 
sure-sensitive tablet 9 is converted to digital data (coor- 
dinate position data) by an analog/digital converter 10, 
and is sent to the CPU 1 via the ASIC 6. On the basis of 
the coordinate position on the liquid crystal display 
panel 8 of the contents actually displayed on the liquid 
crystal display panel 8 and the coordinate position data 
inputted from the pressure-sensitive tablet 9, the CPU 1 
judges what information is inputted from the input pen 
25. 

The pen-input computer 30 also has an audio 
reproduction circuit 13 and a speaker 14 to which an 
output of the audio reproduction circuit 13 is supplied. 
Under the control of the CPU 1 , as audio data stored in 
the ROM 2 or the RAM 3 is supplied to the audio repro- 
duction circuit 13, the audio data is outputted as sounds 

•from the speaker 14. 
In addition, the pen-input computer 30 has a power 
button 1 1 indicating ON/OFF of a power source. When 
power ON operation is performed at power button 1 1 , 



the power obtained from a main battery 21 or an AC 
adaptor 22 is supplied to each constituent element via a 
power source block 20 as a power circuit. The pen-input 
computer 30 also has a back-up battery 23 for the RAM 

5 3. When the power cannot be obtained from the main 
battery 21 or the AC adaptor 22, the back-up battery 23 
backs up the RAM 3 so as to prevent erasure of the data 
stored in the RAM 3. 

Fig.2 shows schematic appearance of the pen- 

10 input computer 30 of the present embodiment. 

In Fig.2. the pen-input computer 30 of the present 
embodiment has the circuit portion of Fig.1 provided 
within a casing 31 . On the top side of the casing 31 , the 
speaker 14 and the liquid crystal display panel 8 having 

15 the pressure-sensitive tablet 9 on the surface thereof 
are arranged. The liquid crystal display panel 8 is 
located substantially at the center on the top side of the 
casing 31 . By touching the pressure-sensitive tablet 9 
provided on the liquid crystal display panel 8 using the 

20 input pen 25, for example, input by the pen is enabled. 
On the right lateral side of the casing 31, for example, 
the power button 1 1 and the card slot 4 are arranged. 

The basic idea in the case where the text input 
method of the present invention is applied to the pen- 

25 input computer of the present embodiment having the 
above-described structure will now be explained. 

In the text input method of the existing pen-input 
computer, it is normal that the user provides a large 
amount of information relating to an input character 

30 array. Specifically, as described above, in the pen-input 
computer employing the handwritten character recogni- 
tion system, input of a character is regarded as being 
done only when the user writes the character correctly. 
In the pen-input computer employing the soft keyboard 

35 and kana-kanji conversion system, kana-kanji conver- 
sion is performed only when complete reading of a char- 
acter array is inputted from the soft keyboard. 

On the contrary, by picking up a plurality of candi- 
date characters, words and phrases (hereinafter collec- 

40 tively referred to as words) as retrieval conditions with 
respect to partial information about a character array to 
be inputted, such as, a leading character of the charac- 
ter array to be inputted or several characters included in 
the character array, then selecting necessary words 

45 from these candidates and connecting the obtained 
words, text input is enabled without providing complete 
information about the character array to be inputted. 

That is, particularly in the pen-input computer, the 
selecting operation may be performed at a high speed 

so though the character input operation cannot be per- 
formed as speedily as the computer having the hard- 
ware keyboard. Therefore, it is considered that high- 
speed character input may be performed in the pen- 
input computer by employing at least the following four 

55 policies different from those of the computer having the 
hardware keyboard. 

A first policy is to provide retrieval conditions by a 
simple operation. 
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A second policy is to dynamically change a set of 
candidate words in accordance with a change in the 
retrieval conditions so as to retrieve and display the can- 
didate words, and use these candidate words as selec- 
tion objects. 

A third policy is to select a target word from the plu- 
ral candidates displayed as retrieval results. 

A fourth policy is to calculate the likelihood of 
appearance of words from a determined character array 
immediately before the input position of the word or the 
general appearance frequency of the word and the con- 
text, and display the candidates in the order of likelihood 
of appearance. 

In order to realize these four policies, specifically, 
the following method is employed. 

In the designation of retrieval conditions, a part of 
reading of the input character array is designated as a 
retrieval condition using the soft keyboard displayed on 
the screen. That is, the retrieval condition for retrieving 
a word to be inputted is designated by selecting a key 
corresponding a leading one character of the word to be 
inputted or keys corresponding to several characters 
from the leading character or several characters inter- 
mittent from the leading character, instead of the entire 
reading of the word, from the keys on the soft keyboard 
using the input pen. As the method for designating the 
retrieval condition, it is also possible to designate plural 
characters indicating the reading by a single operation. 

In the retrieval and display of candidate words and 
selection thereof, at the moment when a part of reading 
of the input character array is designated, a set of can- 
didate words starting with that reading is presented as 
selection objects. That is, when the retrieval condition 
(the above-mentioned reading) for retrieving the word to 
be inputted is designated, plural words corresponding to 
the retrieval condition (reading) are displayed as candi- 
dates. However, if the designation of retrieval condition 
is altered, the display of candidate words is immediately 
changed. In addition, in the retrieval of candidate words, 
a prepared exemplary phase is used to predict the input 
word from the character array already determined 
immediately before the word input position and present 
this predicted word preferentially. For example, when 
reading of "o" is designated by the input pen in the case 
where the character array already determined immedi- 
ately before the word input position ends with "yoro- 
shiku", a word "onegai" is preferentially presented as a 
candidate. In this retrieval of candidate words, when 
there is no exemplary phrase matched with the retrieval 
condition (reading), a word of a high use frequency or a 
word matched with the reading among the recently 
selected words is preferentially presented as a candi- 
date word. When there is no word matched with the 
retrieval condition, fuzzy retrieval as later described is 
performed so that a word proximate to the retrieval con- 
dition is presented as a candidate. The plural candidate 
words thus obtained become selection objects in select- 
ing the word to be inputted. The set of candidate words 



in this case is displayed as a menu at a position near the 
soft keys or at a predetermined position. 

On the basis of the above-described four policies 
and specific methods thereof, text input in the pen-input 

5 computer 30 of Fig.1 is hereinafter described in detail 
with reference to Figs.3 to 14. 

A specific example of the case where a Japanese 
sentence of "ikani honshuhou wo mochiita ..." is input- 
ted is described with reference to Figs.3 to 10. In Figs.3 

w to 14, the position of the input pen is indicated by an 
arrow A. 

Fig.3 shows an initial screen of a Japanese soft 
keyboard SKBJ in the order of the Japanese syllabary 
displayed on a screen DPY of the liquid crystal display 

is panel 8 of Figs.1 and 2. In the soft keyboard SKBJ, hira- 
gana soft keys in the order of the Japanese syllabary 
composed of unit characters "a" to "n" (including punc- 
tuation marks " M and " ") and general edit command soft 
keys SKC including "Back Space", "Enter" and "Cancel" 

20 are provided. The hiragana soft keys are arrayed sub- 
stantially in the order of the Japanese syllabary. 

In this state of the initial screen, as shown in Fig.4, 
when a soft key ski of Y is pressed by the input pen 
(arrow A), this Y is designated as a retrieval condition 

25 (reading). When Y is thus designated as a retrieval con- 
dition, a set of plural candidate words starting with Y 
are displayed as a pull-down menu PDMJ on the screen 
DPY, as shown in Fig.4. The pull-down menu is gener- 
ally a menu display system for displaying a list of 

30 selectable work items on the screen in designating a 
work to the computer and allowing the user to select a 
target work from the list. In this system, the menu of 
work items appears on the screen as if a scroll were 
pulled out In the present embodiment, the candidate 

35 words are displayed in the pull-down menu in place of 
the work items. 

As the pull-down menu PDMJ of Fig.4, among 
words starting with Y, approximately 10 candidate 
words from the word of the highest appearance fre- 

40 quency (for example, "i", "ima", "intahuesu", "iru", "ika'\ 
"ita", "ii", "iu", "itsu M , "idou" "inai", "imasu" etc.) are dis- 
played as menu items. In the following description, each 
menu item of each displayed candidate word is referred 
to as a menu key. As a matter of course, the number of 

45 candidate words displayed as the pulldown menu 
PDMJ is not limited to approximately 10 and may be 
smaller or greater. The number of displayed candidate 
words is determined in consideration of the size of the 
screen DPY and the proportion to other display con- 

so tents. When the pull-down menu PDMJ is displayed, the 
display of the soft keyboard SKBJ is disturbed. There- 
fore, it is also possible to perform menu display of the 
same contents as the pull-down menu PDMJ in a place 
other than the display area of the soft keyboard SKBJ 

55 (preferably, at a position not disturbing other display 
contents). 

In the state of the display of Fig.4, if the input pen is 
released, the candidate words which have been dis- 
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played in the pull-down menu PDMJ of Fig,4 are now 
displayed as a pop-up menu PUMJ at a lower part of the 
screen DPY, as shown in Fig.5, and the display of the 
pulldown menu PDMJ of Fig.4 is extinguished. The 
pop-up menu is a menu display system of the same type 5 
as the pull-down menu and is adapted for displaying a 
menu at an arbitrary position on the screen. In the 
present embodiment, the pop-up menu is displayed at 
the lower part of the screen DPY as shown in Fig.5. 
However, it may be displayed at other positions and w 
preferably at a position not disturbing other display con- 
tents. 

In this pop-up menu PUMJ of Fig.5, too, candidate 
words are arrayed sequentially from a word of the high- 
est appearance frequency. Since the pop-up menu 15 
PUMJ in this case is displayed outside of the soft key- 
board SKBJ, the number of displayed candidate words 
may be greater than in the case of the pull-down menu 
PDMJ of Fig.2. In the case of Fig.5, candidate words of 
"i", "ima", "intahuesu", "iru", "ika", "ita", "ii", "iu", "itsu", 20 
"imasu", "idou", "inai", "identeki", "ichi", "iki", "itsumo", 
"izen", "imi", etc. are displayed. 

In the state of the display of Fig.5, if a menu key cor- 
responding to a desired candidate word on the pop-up 
menu PUMJ is touched with the pen, the candidate 25 
word corresponding to the menu key is selected. Thus, 
the selected candidate word may be inputted. After the 
candidate word is selected, the display of the pop-up 
menu PUMJ is extinguished. 

In addition, when the pen is released in the state of 30 
the display of Fig.4, it is also possible to maintain the 
display of the pull-down menu PDMJ of Fig.4 and select 
the desired candidate word from the pull-down menu 
PDMJ, instead of displaying the pop-up menu PUMJ of 
Fig.5. 35 

On the other hand, if V is first designated as a 
retrieval condition as shown in Fig.4 and the input pen 
(arrow A) is moved in contact with the screen DPY onto 
a soft key skK of "ka" as shown in Fig.6, "ika" is desig- 
nated as a retrieval condition. This designation of plural 40 
characters by moving the input pen in contact with the 
screen DPY is referred to as drag processing. When the 
reading of "ika" is thus designated as a retrieval condi- 
tion by the drag processing, a set of candidate words 
starting with "ika" are displayed as a pull-down menu 45 
PDMJ on the screen DPY, as shown in Fig.6. 

As the pull-down menu PDMJ of Fig.6, among 
words starting with "ika", plural candidate words (for 
example, "ika", "ito", "ikari", "igai", "ikani", "iga", "ikaga", 
"ikanimo", "igai", "ikasu", "ikan", "ikahonbun", etc) are 50 
displayed sequentially from the word of the highest 
appearance frequency Thus, in the embodiment of the 
present invention, when the input pen is moved onto 
another character (another soft key) while being in con- 
tact with the screen DPY, the retrieval condition and the 55 
candidate words are dynamically changed. 

In the case of the display of Fig.6, similar to the 
above<iescribed case, the pull-down menu PDMJ may 



be displayed at a position other than the display area of 
the soft keyboard SKBJ (preferably at a position not dis- 
turbing other display contents). 

By releasing the pen in the state of the display of 
Fig.6 and selecting a menu key corresponding to a 
desired candidate word from the pull-down menu PDMJ 
as shown in Fig.7, input of the selected candidate word 
is performed. In the case of Fig.7, a menu key mkl dis- 
played as "ikani" is selected from the pull-down menu 
PDMJ by the input pen (arrow A). 

When the pen is released in the state of the display 
of Fig.6, the candidate words which have been dis- 
played in the pull-down menu PDMJ of Fig.6 may be dis- 
played as the pop-up menu PUMJ at the lower part of 
the screen DPY as shown in Fig.5. 

By procedures similar to those described above, 
when the drag processing is performed to designate a 
soft key skN of "n" without releasing the input pen from 
the screen DPY after a soft key of "ho M is pressed with 
the pen, "hon" is designated as a retrieval condition. As 
the reading of "hon" is thus designated as a retrieval 
condition, a set of candidate words starting with "hon" is 
displayed as a pull-down menu PDMJ on the screen 
DPY, as shown in Fig.8. 

As the pull-down menu PDMJ of Fig.8, among 
words starting with "hon", candidate words (for exam- 
ple, "hon", "honzitsu", "honbun", "honronbun", "hontai", 
"hontou", "honshitsuteki", "honnen", "honkou", "hon- 
shou'\ "honhatsumei", "honshuhou", "honhoushiki", 
"honsetsu", etc.) are displayed sequentially from the 
word of the highest appearance frequency. In the 
present embodiment, for example, a menu key dis- 
played as "honshuhou" is selected from the pull-down 
menu PDMJ by the pen. 

By the foregoing procedures, the character array 
determined at this point is "ikani honshuhou". The char- 
acter array thus determined is displayed at a position on 
the screen where the soft keyboard, the edit command 
soft keys, the pull-down menu and the pop-up menu are 
not displayed. 

Next, on the screen DPY, a set of candidate words 
in the order from a word which most frequently appears 
immediately after the determined character array of 
"ikani honshuhou" is displayed as a pop-up menu 
PUMJ, as shown in Fig.9. The set of candidate words 
which frequently appear immediately after the deter- 
mined character array of "ikani honshuhou" includes 
"wa", "wo", "wo bunshohenshu", "wa tanjun", "no", "ga", 
"wo mochiite", "to", "wo tekiyou", "ni'\ "no kirikae", "niy- 
ori", "wo teian", "wo tsukau", "nituite", "no yugou", "de", 
etc. These candidate words are displayed as the pop-up 
menu PUMJ of Fig.9. In the present embodiment, as a 
menu key mkO displayed as "wo" is selected by the pen 
(arrow A) from the pop-up menu PUMJ in the state of 
the display of Fig.9, the determined character array 
becomes "ikani honshuhou wo". 

As shown in Fig.9, "wo", "wa" and the like on the 
pop-up menu PUMJ are candidate words which fre- 
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quently appear immediately after the determined char- 
acter array of "ikani honshuhou". Each candidate word 
displayed at this point is displayed as the pop-up menu 
PUMJ even though the user does not designate the 
retrieval condition as the reading by the soft keyboard 
SKBJ. Each candidate word may be directly selected 
from the candidate words displayed on the pop-up 
menu PUMJ by using the input pen 25. 

Next, on the screen DPY, a set of candidate words 
in the order from a word which most frequently appears 
immediately after the determined character array of 
"ikani honshuhou wo" is displayed as a pop-up menu 
PUMJ, as shown in Fig. 10. The set of candidate words 
at this point includes "bunshohenshu", "mochiite", "teki- 
you", "teian", "tsukau", "heiyou", "sentaku", "sen- 
takushi", "mochii", "shiyoushi", "tsukawa", "mochiita", 
"okona", "nyuryoku", "yosoku", "sakusei", "okonau", 
"zikkou", etc. These candidate words are displayed as 
the pop-up menu PUMJ of Fig. 10. In the present 
embodiment, as a menu key mkM displayed as "mochi- 
ita" is selected by the pen (arrow A) from the pop-up 
menu PUMJ in the state of the display of Fig. 10, the 
determined character array becomes "ikani honshuhou 
wo mochiita". 

in the case of Fig. 10, too, the candidate words 
which frequently appear immediately after the deter- 
mined character array "ikani honshuhou wo" are dis- 
played as the pop-up menu PUMJ even though the user 
does not designate the retrieval condition as the reading 
by the soft keyboard SKBJ. Therefore, each candidate 
word may be directly selected from the candidate words 
displayed on the pop-up menu PUMJ by using the pen. 

By the above-described procedures, the character 
array of "ikani honshuhou wo mochiita" may be deter- 
mined. 

In the text input procedures according to the 
present invention up to this point, it can be seen that the 
character array of "ikani honshuhou wo mochiita" is 
inputted by six operations, on the assumption that one 
operation includes the operation of touching the screen 
DPY with the pen and releasing the pen. 

On the contrary, in the case where the character 
array of "ikani honshuhou wo mochiita" is to be inputted 
by using the existing pen-input computer employing the 
handwritten character recognition system, the total of 
about 40 operations are required. In the case of the 
pen-input computer employing the soft keyboard and 
the kana-kanji conversion system, at least about 20 
operations are required. In the case where the charac- 
ter array of "ikani honshuhou wo mochiita" is to be input- 
ted by using the conventional pen-input computer 
employing the soft keyboard and the kana-kanji conver- 
sion system, soft keys of Y and "ka" are first designated 
and then a soft command key "Convert" for kana-kanji 
conversion is designated to determine the character 
array "ika" (i.e., three operations). Next, a soft key of "ni" 
is designated and then a soft command key "Deter- 
mine" is designated to determine the character "ni" (i.e., 



two operations). Next, soft keys of "ho" and "n" are des- 
ignated and then the soft command key "Convert" is 
designated to determine the character "hon" (i.e., three 
operations). Subsequently, soft keys of "shi" and "yu" 

5 are designated and a soft command key "Character 
Convert" for converting the character "yu" into a small 
letter is designated (i.e., three operations). Next, soft 
keys of "ho" and V are designated and then the soft 
command key "Convert" is designated to determine the 

10 character array "shuhou" (i.e., three operations). Then, 
a soft key of "wo" is designated and then the soft com- 
mand key "Determine" is designated to determine the 
character "wo" (i.e., two operations). Finally, soft keys of 
"mo", "chi", Y and "ta" are sequentially designated and 

is then the soft command key "Convert" is designated (i.e. , 
five operations). Thus, input of the character array of 
"ikani honshuhou wo mochiita" is determined. In this 
manner, with the conventional pen-input computer 
employing the soft keyboard and the kana-kanji conver- 
ge sion system, the total of 21 operations (= 
3+2+3+3+3+2+5) are required for inputting the charac- 
ter array of "ikani honshuhou wo mochiita". 

Figs.3 to 10 show the operations and exemplary 
displays in the case of Japanese input. However/in the 

25 case of English input, operations and displays as shown 
in Figs.1 1 to 14 are carried out The reference numerals 
in Figs. 11 to 14 correspond to those in Figs.3 to 10. 

Fig. 11 shows an initial screen of a soft keyboard 
SKBE composed of unit characters including alphabetic 

30 characters and numeric characters displayed on the 
screen DPY Of the liquid crystal display panel 8. In the 
soft keyboard SKBE, alphabetical soft keys of "A" to "Z" 
(including symbolic characters " ( " ) ", "#", etc.) and 
general edit command soft keys SKC including "Back 

35 Space", "Enter" and "Cancel" are provided. The edit 
command soft keys SKC may be displayed also in Jap- 
anese or other languages. 

In this state of the initial screen, as shown in Fig. 12, 
if a soft key skF of "F", for example, is pressed by the 

40 input pen (arrow A), "F is designated as a retrieval con- 
dition (reading). When "F" is thus designated as a 
retrieval condition, a set of plural candidate words start- 
ing with "F" is displayed as a pull-down menu PDME on 
the screen DPY, as shown in Fig, 12. 

45 As the pull-down menu PDME of Fig. 12, among 
words starting with "F", approximately 10 candidate 
words from the word of the highest appearance fre- 
quency (for example, "F", "for", "from", "figure", "first", 
"found", "form", "focus", "feedback", "features", etc.) are 

so displayed as menu items (menu keys). In the state of the 
display of Fig. 12, a desired candidate word is selected 
from the candidate words displayed as the pull-down 
menu PDME. For example, if a menu key mkf of 'first" is 
selected, the character "first" is determined, as shown in 

55 Fig.13. 

In the state of the display of Fig. 12, by releasing the 
input pen, the candidate words which have been dis- 
played in the pulldown menu PDME of Fig.12 may be 
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displayed as a pop-up menu PUME at a lower part of 
the screen DPY, as shown in Fig. 14. In this pop-up 
menu PUME of Fig.14, too, candidate words are 

I arrayed sequentially from a word of the highest appear- 
ance frequency. In the pop-up menu PUME in Fig.14, 
for example, candidate words of "F", "for", "from", "fig- 
ure", "first", "found", "form", "focus", "feedback", "fea- 
tures", "further", "following", "four", etc, are displayed. In 
the state of the display of Fig.14, a desired candidate 
word is selected from the candidate words displayed in 
the pop-up menu PUME. in the case of Fig.14, a menu 
key mkf of "first" is selected. 

In the above-described English input, similar to the 
previous case of Japanese input, English text input may 
be carried out by simple selection operations. 

Thus, the text input method according to the 
present invention is not only effective for the input 
accompanying conversion operations (such as, hira- 
gana-kanji conversion and alphabetic character to hira- 
gana and kanji conversion) as in Japanese input, but 
also applicable to text input in a language not requiring 
conversion operations, such as, English, French or Ger- 
man. Particularly, in the text input method of the present 
invention, since an English word or the like is inputted 
by selecting the word from the plural candidate words as 
described above, it is anticipated that the spell check 
operation which is necessary for ordinary English text 
input becomes substantially unnecessary. 

In the case where the determined text is to be cor- 
rected or erased, the edit command soft keys SKC are 
used. 

Meanwhile, in order to effectively realize the text 
input method of the embodiment as described above, a 
word dictionary and an exemplary phrase dictionary of 
high quality are required. 

For example, as the word dictionary used in the 
embodiment of the Japanese input, a format of word 
dictionary as shown in Fig.15 may be considered. The 
word dictionary of the format shown in Fig.15 has a list 
structure which includes reading (reading of a candi- 
date word) as a first element on the left side in Fig.15 
and the candidate word as a second element on the 
right side in Fig.15. 

As the exemplary phrase dictionary for the Japa- 
nese input used in the embodiment, a format of exem- 
plary phrase dictionary as shown in Fig. 16 may be 
considered. The exemplary phrase dictionary of the for- 
mat shown in Fig. 16 has a list structure which includes 
a first element indicating a determined character array 
as a retrieval condition on the left side in Fig. 16, the 
reading of a candidate word as a second element at the 
center of Fig. 16, and the candidate word as a third ele- 
ment on the right side in Fig. 16. Specifically, in the 
exemplary phrase dictionary shown in Fig. 16, in the 
case where the character array of the second element is 
knatched with the character array immediately before 
the input position, the character array of the third ele- 
ment shown on the right side in Fig. 16 is determined as 



the candidate word when the retrieval condition (read- 
ing) of the first element shown on the left side of Fig.16 
is designated. 

In the present embodiment, when retrieval of a can- 
5 didate word is performed in response to the retrieval 
condition, the above-described retrieval policies may be 
realized simply by carrying out matching operation from 
the leading part of the dictionaries shown in Figs. 15 and 
16. 

w These dictionaries of Figs. 15 and 16 have such 
structures as to allow easy retrieval of a text produced 
before. That is, since words and exemplary phrases 
selected at the time of producing a text are added to the 
leading parts of these dictionaries, the words and exem- 

15 plary phrases added to the leading parts are preferen- 
tially displayed as candidates in the next retrieval. For 
example, it is easy to input a text similar to the text which 
is inputted immediately before. 

In the case where 10 candidate words, for example, 

20 are to be displayed in the pull-down menu or pop-up 
menu using a word dictionary containing 22000 words, 
. for example, 471 candidate words may be selected by 
selection of the reading of the first one character and 
selection of a menu key, and 861 1 candidate words may 

25 be selected by selection of the reading of the first two 
characters and selection of menu keys. In the case 
where 10 candidate words are to be displayed in the 
pull-downs menu or pop-up menu, the probability that a 
candidate word to be selected in the exemplary phrase 

30 among the 471 candidate words will appear on the pull- 
down menu or pop-up menu by performing selection of 
the reading of the first one character and selection of 
the menu key is 44%, and the probability that the candi- 
date word to be selected in the exemplary phrase 

35 among the 8611 candidate words will appear on the 
pull-down menu or pop-up menu by performing selec- 
tion of the reading of the first two characters and selec- 
tion of the menu keys is 85%. In addition, by performing 
selection of the reading of the first three characters and 

40 selection of the menu keys, the probability that the can- 
didate word to be selected in the exemplary phrase will 
appear on the menu is increased to 97% or higher. 
Thus, with the retrieval processing of the candidate 
word in the text input method of the present embodi- 
es ment, almost all candidate words required at the time of 
text input may be selected, simply by designating the 
reading of one or two characters. 

However, these probabilities of appearance fre- 
quency are calculated on the assumption that predicted 

so candidate retrieval for predicting a candidate word of the 
highest appearance frequency from the determined 
character array as described with reference to Rgs.9 
and 10 is not used. Actually, as the predicted candidate 
retrieval functions, the appearance frequency of the 

55 required candidate word is increased further, and in a 
greater number of cases, the word may be inputted 
without designating the reading as the retrieval condi- 
tion as in the case of Figs. 9 and 10. 
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In addition, in the present embodiment, different 
dictionaries may be used in accordance with the type 
and context of the text to be produced, thus enabling 
more effective text input. For example, input of 
addresses in producing a name list database is faciii- 5 
tated by using, as a dictionary, a place name list con- 
taining the names of places as candidate words. Also, 
exemplary phrases in producing a letter may be easily 
retrieved by using an exemplary phrase dictionary con- 
taining a set of exemplary phrases as candidate words, w 
In the case of the dictionary of place name list, the 
names of places as candidate words may be easily 
retrieved and designated by forming a hierarchical 
structure in the order of, for example, prefecture, county, 
city, town, village, and street number. 1S 

In the above description, the dictionaries for the 
Japanese input are explained. However, similar effects 
may be obtained in the case of the English input. As a 
matter of course, the similar effect may be obtained not 
only in the case of the Japanese input using the above- 20 
described soft keyboard of Japanese hiragana charac- 
ters, but also in the case of the Japanese input based on 
so-called Roman character input using the soft key- 
board of alphabetic characters. 

In the above-described Japanese input and English 25 
input, the fuzzy retrieval is not performed. However, if 
there are few or no candidate words starting with the 
reading designated as a retrieval condition, the pen- 
input computer of the present embodiment performs the 
fuzzy retrieval. Specifically, in the Japanese input, if the 30 
reading of "teke", for example, is designated as a 
retrieval condition, since there are few words starting 
with "teke", fuzzy retrieval using "te" and "ke" as retrieval 
conditions is performed. This fuzzy retrieval enables 
display of a word "densouken" or the like as a candidate 35 
word. In the English input, for example, a word "pithe- 
canthropus" may be inputted simply by designating "p", 
T, "p" and "s". 

Using an example of the English input, retrieval of a 
correct candidate word by the fuzzy retrieval will now be 40 
described. 

In the text input method of the present embodiment, 
two types of regular expression recognition algorithms 
are used together in the word dictionary in order to per- 
form fuzzy retrieval at a high speed. For example, when 45 
a character array of "ab ca" ("ab.*cd" in regular expres- 
sion) is to be retrieved, a state transition machine for 
recognizing this character array pattern of "ab ca" may 
be expressed as shown in Fig. 17. The symbol "* M may 
indicate any input character. In the state transition so 
machine of Fig. 17, an initial state SO is shifted to a next 
state S1 by an input character "a", and the state S1 is 
shifted to a state S2 by an input character "b'\ The state 
S2 is not shifted by an input character but is shifted 
to a state S3 by an input character V, and the state S3 55 
is shifted to a state A by an input character "a". This 
state A is referred to as a final state or acceptance state, 
which indicates whether the input character array "ab 



ca" has been accepted or not. When the input charac- 
ters "a", "b", "c" and "a" are not provided, the states 
SO, S1 , S2, S3 and A are extinguished. 

The state transition machine expressed as in Fig. 17 
may be extended to a machine allowing mismatch 
(wrong word/omitted word/wrong insertion) by increas- 
ing the number of states as shown in Fig. 18. Specifi- 
cally, a state AO in Fig.18 is an acceptance state which 
does not allow mismatch while a state A1 is an accept- 
ance state allowing one wrong character and a state A2 
is an acceptance state allowing two wrong characters. 

As a method for the fuzzy retrieval, a technique of 
performing pattern matching using shift operation is 
described in Fticardo A. Baeza- Yates and Gaston H. 
Connet, A new approach to text searching, Communica- 
tions of the ACM, Vol.35, No.10, October 1992, pp.74- 
82, and Sun Wu and Udi Manber, Agrep - a fast approx- 
imate pattern - matching tool, In Proceedings of USE- 
NIX Technical Conference, San Francisco, CA, January 
1992, pp. 153-1 62. Also, realization of the fuzzy retrieval 
by hardware is described in Hachiro Yamada, Kosuke 
Takahashi, Masaki Hirata, and Hajime Nagai, Character 
array retrieval LSI capable of fuzzy retrieval, Nikkei 
Electronics, No. 422, June 1. 1987, pp.165-181. In addi- 
tion, the inventor of the present application has already 
disclosed a method of fuzzy retrieval in a paper (Infor- 
mation Processing Society of Japan, January 1996, 
pp. 13-23), etc. Therefore, the method of fuzzy retrieval 
will not be described in detail here. In the fuzzy retrieval, 
it is also possible to retrieve a candidate word by input- 
ting several arbitrary characters in the character array in 
the appearing order within the character array, instead 
of inputting the leading character of the character array. 

Hereinafter, flows of processing in the structure of 
Fig.1 for realizing the specific text input as described 
above will be described with reference to flowcharts of 
Figs. 19 to 23. The processing of these flowcharts is 
realized as the CPU 1 controls each constituent ele- 
ment and performs data processing in accordance with 
the text input program stored in the ROM 2. That is, the 
text input program stored in the ROM 2 is a program for 
the CPU 1 to execute the processing of the flowcharts. 
Figs. 19 and 20 show an entire flow of character input 
processing in the pen-input computer 30 having the 
structure of Fig.1. Although Figs. 19 and 20 should be 
presented in one drawing, the flow is divided into two 
parts because of the limited space. Figs.21 and 22 
shows a flowchart of the case where plural characters 
are continuously inputted as retrieval conditions in the 
character input processing (i.e., the drag processing). 
Although Figs.21 and 22, too, should be presented in 
one drawing, the flow is divided into two parts because 
of the limited space. Fig.23 shows a specific flow of pre- 
dicted candidate retrieval processing within the flow- 
chart of the character input processing. 

. First, referring to Fig.1 9, a leading character of a 
character array to be inputted is inputted as the retrieval 
condition, at step ST1 . That is, from among the soft keys 
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of the respective characters on the soft keyboard, the 
reading of the leading character is inputted by the input 
pen 25 for designating the retrieval condition, as 
described above. 

When the input of the leading character is done, the 
CPU 1 stores data of this input character into an unde- 
termined character array buffer provided within the RAM 
3 of Fig.1 , at step ST2, and clears a buffer for storing a 
set of candidate words (hereinafter referred to as candi- 
date set buffer) provided within the RAM 3, at step ST3. 
The undetermined character array buffer is a buffer in 
which a character array designated as a retrieval condi- 
tion is stored. The retrieval condition is constituted by 
not only one character but also a character array of two 
or more characters. Since the character array is not 
determined until the candidate word is selected, in this 
embodiment, the buffer for storing the character array 
designated as the retrieval condition is referred to as the 
undetermined character array buffer. 

At step ST4, the CPU 1 performs retrieval of candi- 
date words having a character (or character array) 
stored in the undetermined character array buffer as a 
leading character (or character array) from the word dic- 
tionary. Such retrieval using the leading character (or 
character array) as a keyword is referred to as forward 
coincidence retrieval. At step ST5, the CPU 1 stores the 
candidate words obtained by forward coincidence 
retrieval of the word dictionary at step ST4, into the can- 
didate set buffer. 

At step ST6, the CPU 1 judges whether or not the 
number of retrieved candidate words is smaller than a 
predetermined number N. This number N corresponds 
to the number which may be displayed on the screen 
DPY as described above, for example, the number of 
candidate words displayed as the pulldown menu PDM 
or the pop-up menu PUM. If it is judged at step ST6 that 
the number of candidate words is N or greater (i.e., NO), 
the operation proceeds to step ST9 as later described. 
If it is judged that the number of candidate words is 
smaller than N (i.e., YES), the operation proceeds to 
step ST7. 

At step ST7, since the number of retrieved candi- 
date words is still smaller than the number N which may 
be displayed on the screen DPY, further retrieval of can- 
didate words from the word dictionary is performed. The 
retrieval in this case is the fuzzy retrieval. The number of 
candidate words retrieved by the fuzzy retrieval may be 
the number defining the number which may be dis- 
played on the screen DPY, together with the number of 
previously retrieved candidate words. After the fuzzy 
retrieval of step ST7, at step ST8, the CPU 1 adds the 
obtained retrieval results (the set of candidate words) to 
the candidate set buffer. At step ST9, the CPU 1 reads 
out the set of candidate words stored in the candidate 
set buffer and displays the candidate words as a menu 
(the pull-down menu or the pop-up menu) on the liquid 
crystal display panel 8. 

At step ST10, the CPU 1 judges whether there is 



input of an additional character or not, that is, whether 
or not one character (reading) to be added as a retrieval 
condition is newly inputted by the input pen 25, or 
whether or not a character array is inputted by the drag 

5 processing. If there is input of an additional character at 
step ST10 (i.e., YES), the operation returns to step ST2, 
where the added character is added to the character (or 
character array) previously stored in the undetermined 
character array buffer and is stored in the undetermined 

w character array buffer. After that, the processing from 
step ST3 to step ST10 is similarly performed, using the 
character array stored in the undetermined character 
array buffer as the retrieval condition. Similar process- 
ing is performed when there is further input of an addi- 

is tional character at step ST10. 

If it is judged that there is no input of an additional 
character at step ST10. the CPU 1 judges at step ST1 1 
whether the candidate word has been determined or 
not, that is, whether or not the correct candidate word 

20 has been selected from the pull-down menu or the pop- 
up menu \displayed on the screen DPY If the candidate 
word has not been determined at step ST1 1 (i.e., NO), 
the operation returns to step ST10. If the candidate 
word has been determined (i.e., YES), the operation 

25 proceeds to step ST1 2. 

As the candidate word has been determined, the 
CPU 1 clears the undetermined character array buffer at 
step ST12 in order to proceed to the next character 
input processing. Then, the CPU 1 performs the 

30 processing of step ST21 and subsequent steps in 
Fig.20. Since the input of at least one word has already 
been determined by the processing of the flowchart of 
Fig. 19, predicted candidate retrieval for predicting a 
candidate word which should follow the determined 

35 word (for example, a candidate word having the highest 
appearance frequency) is performed on the basis of the 
determined word (character array), at step ST21 of 
Fig.20. As a set of candidate words is obtained by the 
predicted candidate retrieval, the CPU 1 displays the set 

40 of candidate words on the liquid crystal display panel 8 
at step ST22. 

At step ST23, the CPU 1 judges whether there is 
input of an additional character or not, that is, whether 
or not one character to be added as a retrieval condition 

45 is newly inputted by the input pen 25, or whether or not 
a character array is inputted by the drag processing. 

If there is input of an additional character at step 
ST23 (i.e., YES), the newly added character is added to 
the character (or character array) stored in the undeter- 

so mined character array buffer and is stored in the unde- 
termined character array buffer at step ST27. After that, 
the processing from step ST21 to step ST23 is per- 
formed similarly, using the character array stored in the 
undetermined character array buffer as the retrieval 

55 condition. Similar processing is performed when there is 
further input of an additional character at step ST23. 

If it is judged that there is no input of an additional 
character at step ST23, the CPU 1 judges at step ST24 
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whether determination of the candidate word has been 
completed or not, that is, whether or not the correct can- 
didate word has been selected from the pull-down menu 
PDM or the pop-up menu PUM displayed on the screen 
DPY If it is judged at step ST24 that the candidate word 
has not been determined (i.e., NO), the operation 
returns to step ST23. If the candidate word has been 
determined (i.e., YES), the operation proceeds to step 
ST25. 

The CPU 1 clears the undetermined character 
array buffer at step ST25, and then proceeds to step 
ST26. At step ST26, the CPU 1 judges whether input of 
one text has been, completed or not. If it is judged at 
step ST26 that the input has not been completed (i.e., 
NO), the operation returns to step ST21 and the 
processing from step ST21 to step ST26 is repeated 
until it is judged at step ST26 that the input has been 
completed. When it is judged at step ST26 that the input 
has been completed (i.e., YES), the character input 
processing ends. 

Referring to Figs.21 and 22, the flow of the drag 
processing is hereinafter described. 

First, in Fig.21, the CPU 1 judges at step ST31 
whether or not the input pen 25 is located on the screen 
DPY of the liquid crystal display panel 8, that is, on the 
soft keyboard SKBJ (more specifically, whether or not 
the input pen 25 is located on the pressure-sensitive 
tablet 9 corresponding to the character soft key sk on 
the soft keyboard SKBJ). If it is judged at this step ST31 
that the input pen 25 is located on the character soft key 
sk (i.e., YES), the operation proceeds to step ST32. If it 
is judged that the input pen 25 is not located on the 
character soft key sk (i.e., NO), the operation proceeds 
to step ST39. 

As it is judged at step ST31 that the input pen 25 is 
located on the character soft key sk, the CPU 1 judges 
at step ST32 whether the input pen 25 has been 
released from the screen DPY or not (more specifically, 
whether the input pen 25 has been released from the 
pressure-sensitive tablet 9 or not). If it is judged that the 
input pen has not been released, the operation pro- 
ceeds to step ST33. if it is judged that the input pen has 
been released, the operation proceeds to step ST51 of 
Fig.22. 

When it is judged at step ST32 that the input pen 25 
has not been released from the screen DPY, the CPU 1 
judges at step ST33 whether or not a predetermined 
time has lapsed since the input pen 25 was put on the 
same character soft key sk. If it is judged at step ST33 
that the predetermined time has not lapsed, the opera- 
tion returns to step ST31. If it is judged that the prede- 
termined time has lapsed, the operation proceeds to 
step ST35. 

As it is judged at step ST33 that the predetermined 
time has lapsed since the input pen 25 was put on the 
same character soft key sk, the CPU 1 selects the char- 
acter of that soft key sk as an input character, at step 
ST35. At step ST36. the CPU 1 stores the character into 



20 

the undetermined character array buffer (or adds this 
character if any character has already been stored). 

At step ST37, the CPU 1 performs candidate word 
retrieval processing using the character array stored in 

5 the undetermined character array buffer. In addition, at 
step ST38, the CPU 1 displays a set of candidate words 
obtained by the retrieval onto the screen DPY. The dis- 
play position of the set of candidate words is set near 
the character soft key on which the input pen 25 is 

10 located, as in the above-described pull-down menu 
PDM. After the processing of step ST38 is completed, 
the operation returns to step ST31. 

On the other hand, if it judged at step ST31 that the 
input pen 25 is not located on the character soft key sk, 

is the CPU 1 judges at step ST39 whether or not the input 
pen 25 is located on the pull-down menu PDM or the 
pop-up menu PUM in which the set of candidate words 
is displayed (more specifically, whether or not the input 
pen 25 is in contact with the pressure-sensitive tablet 9 

20 corresponding to the menu key mk displaying the candi- 
date word on the menu). If it is judged at step ST39 that 
the input pen 25 is located on the menu key mk, the 
operation proceeds to step ST40. if it is judged that the 
input pen 25 is not located on the menu key mk, the 

25 operation proceeds to step ST42. 

As it is judged at step ST39 that the input pen 25 is 
located on the menu key mk, the CPU 1 judges at step 
ST40 whether or not the input pen 25 has been 
released from the screen DPY. If it is judged that the 

30 input pen has been released, the operation proceeds 
step ST41 . If it is judged that the input pen has not been 
released, the operation returns to step ST31. 

When it is judged at step ST40 that the input pen 25 
has been released from the screen DPY the CPU 1 

35 assumes that selection of the candidate word is com- 
pleted at step ST41 and ends the drag processing. 

On the other hand, when it is judged at step ST39 
that the input pen 25 is not located on the menu key mk, 
the CPU 1 judges at step ST42 whether or not the input 

40 pen 25 has been released from the screen DPY. If it is 
judged that the input pen has been released, the opera- 
tion proceeds to step ST53 of Fig. 22. If it is judged that 
the input pen has not been released, the operation 
returns to step ST31. 

45 Moreover, when it is judged at step ST32 that the 
input pen 25 has been released from the screen DPY, 
the CPU 1 selects the character on the character soft 
key sk as an input character at step ST51 of Fig. 22. At 
the next step ST52, the CPU 1 stores that character into 

so the undetermined character array buffer (or adds that 
character if any character has already been stored). 

After that, the operation of the CPU 1 proceeds to 
step ST53. Also in the case where judgment YES is 
made at step ST42 of Fig.21 , the operation proceeds to 

55 this step ST53. 

At step ST53, the CPU 1 judges whether or not a 
character array as the retrieval condition is stored in the 
undetermined character array buffer. If it is judged that 
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the character array is not stored, the drag processing 
ends. If it is judged that the character array is stored, the 
operation proceeds to step ST54. 

At step ST54, the CPU 1 performs candidate word 
retrieval using the character array stored in the undeter- 
mined character array buffer. At step ST55, the CPU 1 
displays a set of candidate words obtained by the 
retrieval, in a menu, and then ends the drag processing. 

The flow of predicted candidate retrieval processing 
at step ST21 of Fig.20 is hereinafter described with ref- 
erence to the flowchart of Fig.23. 

In Fig.23, the CPU 1 first clears the candidate set 
buffer at step ST61 , and performs retrieval of the above- 
described exemplary phrase dictionary at the next step 
ST62. After the retrieval of the exemplary phrase dic- 
tionary, the CPU 1 stores candidate words obtained by 
the retrieval into the candidate set buffer (or adds the 
candidate words if any candidate word has already 
been stored), at step ST63. 

At step ST64, the CPU 1 judges whether the 
number of retrieved candidate words is smaller than the 
predetermined number N or not. If it is judged at step 
ST64 that the number of candidate words is N or 
greater, the predicted candidate retrieval processing 
ends. If it is judged that the number of candidate words 
is smaller than N, the operation proceeds to step ST65. 

At step ST65, the CPU 1 performs the forward coin- 
cidence retrieval of the word dictionary. At the next step 
ST66, the CPU 1 stores candidate words obtained by 
the retrieval into the candidate set buffer (or adds the 
candidate words if any candidate word has already 
been stored). 

After that, at step ST67, the CPU 1 judges again 
whether the number of retrieved candidate words is 
smaller than the predetermined number N or not. If it is 
judged at step ST67 that the number of candidate words 
is N or greater, the predicted candidate retrieval 
processing ends. If it is judged that the number of can- 
didate words is smaller than N, the operation proceeds 
to step ST68. 

At step ST68, the CPU 1 performs the fuzzy 
retrieval of the word dictionary At the next step ST69, 
the CPU 1 stores candidate words obtained by the 
retrieval into the candidate set buffer (or adds the candi- 
date words if any candidate word has already been 
stored). Thus, the predicted candidate retrieval process- 
ing ends. 

Next, results of measurement of text input time and 
operability test at the time of portable use, using the 
pen-input computer realizing the above-described text 
input method of the present embodiment will be 
described in comparison with the text input using the 
conventional pen-input computer. 

Fig.24 shows the results of measurement of the 
time required for inputting an exemplary phrase com- 
posed of 128 characters, using the pen-input computer 
of the present embodiment and the existing pen-input 
computer. The results are obtained on the assumption 



of the same testee. 

From Fig.24, it is understood that the pen-input 
computer of the embodiment to which the text input 
method of the present invention is applied enables input 

5 of the exemplary phrase of 1 28 characters in 120 sec- 
onds (64 characters/minute). On the contrary, with the 
existing pensnput computer, the input of the exemplary 
phrase of 1 28 characters takes at least 260 seconds (30 
characters/minute) and 320 seconds (24 charac- 

10 ters/minute) in the worst case. From these results, it is 
understood that the pen-input computer of the present 
embodiment achieves a significantly higher text input 
speed than the existing pen-input computer. 

Also, the pen-input computer enables easy text 

15 input and editing even in a shaky environment as in a 
moving train and even though the user is standing in the 
train, while input by the existing pen-input computer for 
handwritten input is difficult in a shaky environment as 
in a moving train. 

20 Thus, the pen-input computer of the present 
embodiment realizes the high-speed text input method 
with the pen utilizing dynamic retrieval of candidate 
words and prediction from exemplary phrases. 

Referring to Figs.25 to 31 , the word finding rate and 

25 the finding speed at the time of candidate retrieval in the 
pen-input computer of the embodiment of the present 
invention will now be described briefly. 

Figs.25 to 29 show the relations between the 
number of pen operating times i (i = 0, 1, 2, 3, 4, 5), the 

30 number of candidates displayed in the menu on the 
screen, and the probability that a desired word will exist 
in the menu in the case where text input is performed. 
Fig.25 illustrates the case where English input is per- 
formed. Fig.26 illustrates the case where Japanese 

35 input is performed. Fig.27 illustrates the case where 
English input is performed while predicted candidate 
retrieval is not performed. Fig.28 illustrates the case 
where English input is performed while predicted candi- 
date retrieval is performed. Fig. 29 illustrates the case 

40 where English input is performed while predicted candi- 
date retrieval and adaptive retrieval using the dictionary 
are performed. From Figs.25 to 29, it is understood that 
a desired candidate word may be found with a small 
number of pen operating times and may be found more 

45 easily by predicted candidate retrieval and the like. 

Figs.30 and 31 shows the relation between the 
number of pen operating times i (i = 1, 2, 3, 4, 5), the 
number of candidates displayed in the menu on the 
screen, and the time until a desired candidate word is 

so selected from the menu display and determined. Fig.30 
illustrates the case where predicted candidate retrieval 
is not performed. Fig.31 illustrates the case where pre- 
dicted candidate retrieval is performed. From Figs.30 
and 31. it is understood that a desired candidate word 

55 may be found with a small number of pen operating 
times and may be found more easily by predicted candi- 
date retrieval and the like. 

Finally, Fig.32 shows the schematic structure of a 
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computer 100 for realizing the text input method accord- 
ing to the present invention by using a so-called mouse 
or hardware keyboard. In Fig.32, constituent elements 
similar to those of Fig. 1 are denoted by the same refer- 
ence numerals and will not described further in detail. 5 

In the structure of Fig.32, as means for performing 
designation of the retrieval condition and selection of 
the candidate word, a mouse or keyboard 109 and an 
interface circuit 110 with the computer body are pro- 
vided in place of the pressure-sensitive tablet 9 and the 10 
analog/digital converter 10 of Fig. 1 , and a display drive 
circuit 1 07 and a display device 1 08 are used in place of 
the liquid crystal drive circuit 7 and the liquid crystal dis- 
play panel 8 of Fig.1, The display device 108 is a cath- 
ode ray tube which is often used for a desk-top 15 
computer, or a liquid crystal display used for a portable 
computer. Therefore, the drive circuit 107 and the dis- 
play device 108 of the structure of Fig.32 need not nec- 
essarily replace but may be the same as the liquid 
crystal drive circuit 7 and the liquid crystal display panel 20 
8 of Fig.1. 

In the structure of Fig.32, in the case where the 
mouse is used, a soft keyboard and edit command soft 
keys similar to those described above are displayed on 
the display device 108, and a cursor as an indication 25 
mark operated by the mouse is also displayed. Thus, by 
shifting the mouse cursor onto a desired soft key of the 
soft keyboard and clicking the mouse there, designation 
of the soft key, that is, designation of the retrieval condi- 
tion may be performed. Similarly, in the case of candi- 30 
date word selection, selection of a desired candidate 
word may be realized by shifting the mouse cursor onto 
a desired menu key and clicking the mouse there. 

In addition, in the structure of Fig.32, in the case 
where the hardware keyboard is used, the hardware 35 
keyboard operates as the soft keyboard so that desig- 
nation of the retrieval condition may be performed by 
operating the keys on the hardware keyboard. When the 
retrieval condition is thus designated, for example, a 
menu for displaying the candidate words is displayed on 40 
the screen. To select a desired candidate word from the 
menu, the mouse cursor or the cursor shift keys pro- 
vided on the hardware keyboard are operated to shift 
the cursor onto the desired candidate word and selec- 
tion of the candidate word is executed by a determina- 45 
tion key (return key), for example. In the case where 
hardware structure keys which are the same as the edit 
command soft keys are provided on the hardware key- 
board, the keys are used to perform editing or the like. 

With the structure of Fig.32 t too, effects similar to so 
those in the embodiment of Fig.1 may be obtained. 

As a matter of course, the present invention may be 
applied to a pen-input computer for so-called handwrit- 
ten input. In the case of handwritten input, a handwritten 
input area is provided on the screen of the pen-input 55 
computer so that which character is indicated by a ges- 
ture drawn in the area is recognized, thus performing 
designation of the retrieval condition and selection of 



the candidate word, similar to those described above, in 
accordance with the recognition results. 

As is clear from the above description, the present 
invention provides the text input device and method suit- 
able for a pen-input computer based on retrieval and 
prediction of characters, words, and sentences, etc. By 
repeating the operation of selecting a word from a set of 
candidate words which are selectively collected by par- 
tial designation of reading and prediction from a charac- 
ter array immediately before the input position, the 
present invention enables text input at a high speed 
which is twice or more of the speed of the conventional 
character input method based on handwritten character 
recognition and kana-kanji conversion. 

Claims 

1 . A text input device comprising: 

display means (8) capable of displaying a vir- 
tual keyboard (9) having at least a plurality of 
keys for character input; 
input means (25) for pointing at least each key 
on the virtual keyboard (9) to perform key input 
by the virtual keyboard (9); 
dictionary storage means (2) storing a plurality 
of candidate words and a plurality of exemplary 
phrases; and 

retrieval means (1) for retrieving a plurality of 
candidate words from the dictionary storage 
means, using the key input performed from the 
virtual keyboard (9) by the input means (25) as 
a retrieval condition; 

the retrieval condition and the candidate words 
being dynamically changed in accordance with 
a change in a key input operation state of the 
virtual keyboard (9) by the input means (25). 

2. The text input device as claimed in claim 1 , wherein 
when the same key on the virtual keyboard (9) is 
continuously pointed by the input means for a pre- 
determined time, the retrieval means (1) performs 
retrieval using the pointed key input as the retrieval 
condition. 

3. The text input device as claimed in claim 1 or 2, 
wherein when two or more keys on the virtual key- 
board (9) are pointed in a continuous key input 
operation state by the input means (25), the 
retrieval means (1) performs retrieval using the 
pointed two or more key inputs as the retrieval con- 
dition. 

4. The text input device as claimed in anyone of 
claims 1 to 3, wherein the plurality of candidate 
words retrieved by the retrieval means (1) are dis- 
played as menu items on the display means (8), 
and 
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a desired candidate word is selected by the input 
means from the plurality of candidate words dis- 
played as the menu items on the display means, 
thereby performing text input. 

5 

5. The text input device as claimed in claim 4, wherein 
the retrieval means (1) retrieves the plurality of can- 
didate words to be displayed as the menu items on 
the display means (8) from the dictionary storage 
means (2) on the basis of the input from the input 10 
means and/or an already determined character 
array 

6. The text input device as claimed in claim 4, wherein 
the input means has coordinate position corre- is 
sponding means for causing a physical coordinate 
position on the display means (8) to correspond to 

a display coordinate position on the display means 

(8) , and coordinate position input means for input- 
ting the physical coordinate position to the coordi- 20 
nate position corresponding means, 

the physical coordinate position being inputted, 
thereby indicating the display coordinate position of 
each of the keys on the virtual keyboard (9) dis- 
played on the display means (8) and the display 25 
coordinate position of each of the menu items dis- 
played on the display means. 

7. The text input device as claimed in claim 6, wherein 
the coordinate position corresponding means is a 30 
pressure-sensitive tablet (9) for causing the physi- 
cal coordinate position to correspond to the display 
coordinate position, and the coordinate position 
input means is an input pen (25) for inputting the 
coordinate position to the pressure-sensitive tablet 35 

(9) - 

8. The text input device as claimed in anyone of 
claims 1 to 7, wherein the retrieval means (1) 
retrieves from the dictionary storage means (2) a 40 
plurality of candidate words having a key input char- 
acter inputted from the virtual keyboard (9) by the 
input means (25) as a leading character. 

9. The text input device as claimed in claim 8, wherein 45 
the retrieval means (1) retrieves the plurality of can- 
didate words having the key input character input- 
ted from the virtual keyboard (9) by the input means 
(25) as the leading character, sequentially from a 
candidate word having the highest appearance fre- so 
quency. 

1 0. The text input device as claimed in claim 8, wherein 
the retrieval means (1) retrieves the plurality of can- 
didate words having the key input character input- 55 
ted from the virtual keyboard (9) by the input means 

as the leading character, sequentially from a candi- 
date word selected in the temporally nearest past. 



11. The text input device as claimed in anyone of 
claims 1 to 10, wherein the retrieval means (1) 
retrieves from the dictionary storage means (2) a 
plurality of candidate words, each containing a plu- 
rality of key input characters inputted from the vir- 
tual keyboard (9) by the input means (25) as 
constituent elements. 

12. The text input device as claimed in claim 11, 
wherein the retrieval means (1) retrieves the plural- 
ity of candidate words, each containing the plurality 
of key input characters sequentially inputted from 
the virtual keyboard (9) by the input means (25) as 
constituent elements in the order of the input. 

13. The text input device as claimed in claim 11, 
wherein the retrieval means (1) retrieves the plural- 
ity of candidate words, each containing the plurality 
of key input characters inputted from the virtual key- 
board (9) by the input means (25), sequentially from 
a candidate word having the highest appearance 
frequency. 

14. The text input device as claimed in claim 11, 
wherein the retrieval means (1) retrieves the plural- 
ity of candidate words, each containing the plurality 
of key input characters inputted from the virtual key- 
board (9) by the input means (25), sequentially from 
a candidate word selected in the temporally nearest 
past. 

1 5. The text input device as claimed in claim 5, wherein 
the retrieval means (1) predicts and retrieves a plu- 
rality of candidate words appearing subsequently to 
the already determined character array. 

16. The text input device as claimed in claim 15, 
wherein the retrieval means (1) predicts and 
retrieves the plurality of candidate words sequen- 
tially from a candidate word having the highest fre- 
quency of appearing subsequently to the already 
determined character array. 

17. The text input device as claimed in claim 15, 
wherein the retrieval means retrieves the plurality of 
candidate words to be predicted and retrieved, 
sequentially from a candidate word selected in the 
temporally nearest past. 

18. A text input method comprising: 

a display step of displaying a virtual keyboard 
(9) having at least a plurality of keys for charac- 
ter input; 

an input step (25) of pointing at least each key 
on the virtual keyboard (9) to perform key input 
by the virtual keyboard; and 
a retrieval step (1) of retrieving a plurality of 
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candidate words from a dictionary (2) storing a 
plurality of candidate words and a plurality of 
exemplary phrases, using the key input per- 
formed from the virtual keyboard at the input 
step as a retrieval condition; 
the retrieval condition and the candidate words 
being dynamically changed in accordance with 
a change in a key input operation state of the 
virtual keyboard (9) at the input step (25). 

19. The text input method as claimed in claim 18, 
wherein when the same key on the virtual keyboard 
(9)is continuously pointed (25) for a predetermined 
time at the input step, retrieval (1) is performed 
using the pointed key input as the retrieval condi- 
tion. 

20. The text input method as claimed in claim 18 or 19, 
wherein when two or more keys on the virtual key- 
board (9) are pointed in a continuous key input 
operation state at the input step, retrieval (1) is per- 
formed using the pointed two or more key inputs as 
the retrieval condition. 

21. The text input method as claimed in anyone of 
claims 18 to 20, wherein the plurality of candidate 
words retrieved (1) at the retrieval step are dis- 
played (8) as menu items at the display step, and 

a desired candidate word is selected at the input 
step from the plurality of candidate words displayed 

(8) as the menu items at the display step, thereby 
performing text input. 

22. The text input method as claimed in claim 21, 
wherein at the retrieval step (1), the plurality of can- 
didate words to be displayed as the menu items at 
the display step (8) are retrieved (1) from the dic- 
tionary (2) on the basis of the input by the input step 
and/or an already determined character array. 

23. The text input method as claimed in claim 21, 
wherein at the input step (25), a display coordinate 
position of each of the keys on the virtual keyboard 

(9) displayed at the display step (8) and a display 
coordinate position of each of the menu items dis- 
played at the display step (8) are indicated. 

24. The text input method as claimed in anyone of 
claims 21 to 23, wherein at the retrieval step (1), a 
plurality of candidate words having a key input char- 
acter inputted from the virtual keyboard (9) at the 
input step as a leading character are retrieved (1) 
from the dictionary (2). 

25. The text input method as claimed in claim 24, 
wherein at the retrieval step, the plurality of candi- 
date words having the key input character inputted 
from the virtual keyboard (9) at the input step (25) 



as the leading character are retrieved sequentially 
from a candidate word having the highest appear- 
ance frequency. 

s 26. The text input method as claimed in claim 24, 
wherein at the retrieval step, the plurality of candi- 
date words having the key input character inputted 
from the virtual keyboard (9) at the input step as the 
leading character are retrieved (1) sequentially from 

10 a candidate word selected in the temporally nearest 
past. 

27. The text input method as claimed in anyone of 
claims 21 to 26, wherein at the retrieval step (1), a 
is plurality of candidate words, each containing a plu- 
rality of key input characters inputted from the vir- 
tual keyboard (9) at the input step as constituent 
elements, are retrieved from the dictionary 

20 28. The text input method as claimed in claim 27, 
wherein at the retrieval step, the plurality of candi- 
date words, each containing the plurality of key 
input characters sequentially inputted from the vir- 
tual keyboard (9) at the input step (25) as constitu- 

25 ent elements in the order of the input, are retrieved. 

29. The text input method as claimed in claim 27, 
wherein at the retrieval step, the plurality of candi- 
date words, each containing the plurality of key 
30 input characters inputted from the virtual keyboard 
(9) at the input step (25), are retrieved (1) sequen- 
tially from a candidate word having the highest 
appearance frequency. 

35 30. The text input method as claimed in claim 27, 
wherein at the retrieval step, the plurality of candi- 
date words, each containing the plurality of key 
input characters inputted from the virtual keyboard 
(9) at the input step (25), are retrieved (1) sequen- 
ce tially from a candidate word selected in the tempo- 
rally nearest past. 

31. The text input method as claimed in claim 22, 
wherein at the retrieval step, a plurality of candidate 

45 words appearing subsequently to the already deter- 
mined character array are predicted and retrieved 
0). 

32. The text input method as claimed in claim 31, 
so wherein at the retrieval step (1 ), the plurality of can- 
didate words are predicted and retrieved (1) 
sequentially from a candidate word having the high- 
est frequency of appearing subsequently to the 
already determined character array 

55 

33. The text input method as claimed in claim 31, 
wherein at the retrieval step, the plurality of candi- 
date words to be predicted and retrieved (1) are 
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retrieved sequentially from a candidate word 
selected in the temporally nearest past. 
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